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We consider an M/G/l queue in which the customers, while waiting in line, may renege from it. We study 
the Nash equilibrium profile among customers, and show that it is defined by two sequences of thresholds. 
For each customer, the decision is based on the observed past (which determines from what sequence the 
threshold is taken), and the observed queue length (which determines the appropriate element in the chosen 
sequence). We construct the set of equations that has the Nash equilibrium as its solution, and discuss 
the relationships between the properties of the service time distribution and the properties of the Nash 
equilibrium, such as uniqueness and finiteness. 
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1. Introduction 

Understanding customers’ abandonments from a queue is of interest for both service providers and 
customers. There are many applications concerning customers’ abandonments since real-world cus- 
tomers are unwilling to wait for excessive lengths of time. These applications were presented more 
broadly by Mandelbaum and Shimkin Mandelbaum and Shimkin (2000). Traditional queueing the- 
ory has dealt with the analysis of queues under the assumption of a given patience distribution, and 
many studies have addressed models which include abandonments in the literature, starting with 
Barrel - Barrer (1957), who studied the queue length distribution in the M/M/s + D w case (where 
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D indicates deterministic patience). Sufficient conditions for the existence of the steady-state vir- 
tual waiting time distribution in the G/G/l + G W were later obtained by Baccelli Baccelli (1984, 
1981). Boxma et al. Boxma et al. (2010) showed how to determine the busy period distribution 
for various choices of the patience time distribution, where the busy period is the waiting time 
in the queue. Brandt and Brandt Brant and Brant (2013) also studied the distribution of the 
busy period. In particular, they gave an explicit representation of the Laplace-Stieltjes transform 
of the workload and the busy period, in the case of phase-type distributed impatience. Yet, these 
studies assumed that the patience distribution was given. Here, we investigate the basis of these 
distributions, which are affected by factors such as individual costs and preferences. Essentially, 
the patience of each customer is based on an individual optimization, that is, the perceived bal- 
ance between the costs of waiting and the benefits of service. Since the behaviour of others has 
an influence on the individual (abandonments of others shorten the individual’s required waiting 
time), the mutual interactions lead us to look at the system in the standard form of a game, and 
to seek the Nash equilibrium. Therefore, the patience distribution is no longer given, but instead 
it results from a cost/reward model, and from the strategic behaviour implied by it. 

The seminal study that viewed queues as economic systems, and studied the strategic behaviours 
within them, came from Naor Naor (1969). Naor presented the following model: an observable 
M/M/1 queue, in which there is a constant reward R from service, and a linear waiting cost C. 
He showed that under self-optimization, customers will join the queue if the number of customers 
present upon arrival is less than a threshold, n. This threshold is defined by n= |_y=rj. Moreover, 
once a customer joins the queue, he stays forever. Hassin and Haviv Hassin and Haviv (1995) 
also studied an M/M/1 queue, but in their case the customers have no information about their 
current position in the queue (i.e. , unobservable queue). The waiting cost is the same as in Naor’s 
study. However, the reward is R > 0 if service is completed in less than T time units, otherwise it 
equals 0. They showed that the pure equilibrium is in the form of (p, t). That is, customers join 
the queue with probability p and otherwise balk, and if they join then they wait r time units. 
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Hassin and Haviv showed specifically that r = T. The reason for this result is that the virtual 
waiting time follows an increasing failure rate (IFR) pattern. That is, the remaining waiting time 
stochastically decreases along with the time passed. This is true for every M/M/1 queue with 
impatient customers, as Baccelli and Hebuterne previously showed in Baccelli (1981). Mandel- 
baum and Shimkin Mandelbaum and Shimkin (2000) retained the assumptions of unobservability, 
linear waiting costs and constant service reward, but instead considered an M/M/m queue and 
heterogeneous customers whose waiting costs and rewards may vary between the different cus- 
tomer types. Their results indicate that, depending on the reward to cost ratio, a customer’s best 
response was to either abandon the queue upon arrival unless of course one of the servers was 
available, in which case he enters service immediately or, given the IFR property, to never aban- 
don and wait until receiving service. Of course, within a customer type, all customers follow the 
same strategy (either balk or stay forever), and therefore the Nash equilibrium is pure. However, 
a case in which the solution is richer is when customers are discharged without knowing it, (see, 
e.g. Palm (1953)). Mandelbaum and Shimkin proposed such a model. In their proposed model, 
denoted by M/M/m(q), each customer will never be served with probability 1 — q. In this model, 
the longer a customer has already waited, the higher the posterior probability that he has been 
discharged. It turns out that the M/M/m/q) system has an eventually decreasing (and in fact 
unimodal) hazard rate function, which makes finite abandonments rational. Thus, Mandelbaum 
and Shimkin showed that the best response is to either abandon at arrival, unless, of course, one of 
the servers is available or to abandon after a finite time T, which is determined by the ratio of the 
waiting cost and the reward. A follow up study by Mandelbaum and Shimkin Mandelbaum and 
Shimkin (2004) considered a nonlinear waiting cost in an unobservable M /M/m queue. They pro- 
vided conditions for the existence and uniqueness of the equilibrium, and suggested procedures for 
its computation. Moreover, they suggested a notion of equilibrium based on suboptimal decisions, 
the myopic equilibrium. Another important study, by Haviv and Ritov Haviv and Ritov (2001), 
explored an M/M/1 queue where the waiting cost is nonlinear and the reward from service is no 
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longer constant. They showed that the equilibrium strategy is to abandon after waiting T time 
units in the queue (T = 0 or T = oo are possible). Also, they showed that having a mixed Nash 
equilibrium may occur when the ratio of the cost and reward functions satisfies certain conditions. 
In this model, the waiting time has an IFR, and thus the remaining waiting time reduces with the 
elapsed waiting time. However, the waiting cost is convex, and therefore waiting becomes more 
expensive. The latter balances the improvement in the waiting time and the remaining waiting 
costs. So far, we have introduced a variety of models dealing with customers’ abandonments from 
a queue. They vary in many ways, such as their observability level, their cost and reward functions, 
and number of servers. However, all of these studies had something in common, they all assumed an 
exponential service distribution. In this study, we relax this assumption. In particular, we consider 
an observable M/G/l queue with a First-Come-First-Served (FCFS) discipline. With the term 
observable we mean that everyone can see their own position in the queue at any time, and they 
are able to observe service completions and abandonments made by others. Unlike the case where 
the service distribution is exponential, the age in case of generally distributed service time is 
meaningful. The age determines our anticipation of the remaining time for the current service, and 
consequently the waiting time. Hence, we allow customers to keep track of time. When considering 
utility, we specify that customers have a linear waiting cost and a constant reward from service. 
Customers don’t have a waiting cost while they are being served. We assume that all customers 
are rational, in the sense that every customer wishes to maximize his own utility, and so they will 
stay as long as their utility is positive. Furthermore, we limit ourselves to service distributions with 
decreasing failure rate (DFR), that is, the remaining waiting time stochastically increases with 
time . In fact, in our model, we can use a weaker property. Specifically, we require only that the 
service time mean residual life (MRL) is increasing with its age. Consequently, customers’ expected 
queueing time increases with the service age. If the service time MRL isn’t bounded then rational 
customers will surely abandon at some point, since their utility will eventually be negative. An 
example of this kind of distribution is the Pareto distribution. However, if the service time MRL 
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is bounded, it is possible that customers will be willing to wait forever, given a big enough service 
reward. An example of a distribution of this kind is the hyperexponential. The rest of the paper 
is arranged as follows. In Section 2 we present the model, and customers’ utility and strategy pro- 
file. Next, in Section 3 we give the theoretical framework with instructions on how to obtain the 
Nash equilibrium. This is followed by a numerical example. Finally, in Section 4 we discuss and 
summarize our primary results. 

2. Model formulation 

2.1. Model description 

We consider a single server queueing model in which the arrivals are according to a Poisson process 
with rate A and service times are iid generally distributed. We denote the service time by X, and 
E[X] by x. We also use the notation /(•) for the pdf and F(-) for the cdf, with F (- ) = 1 — F(-), 
and the hazard function is denoted by h(-). The service discipline is FCFS. Each customer can 
see his position in the queue at any moment, and he is able to observe service completions and 
abandonments made by others. However, customers are not aware of events that occurred prior to 
their arrival. Of course, they do not anticipate future service times. Customers can keep track of 
time, and are allowed to abandon at any moment. All customers are homonomous in their reward 
from service, which is denoted by V, and a linear waiting cost, which is denoted by C . In order 
to complete the model description we first present the following definition. For a non-negative 
random variable X with cdf F(-), the MRL function is defined as follows: 

m x (x) = E[A — x\X>x\ = / F —' — ^ clt, x>0 

Jo F{x) 

Also, let m x ( oo) = \\m.m x {x). We distinguish between service distributions in which the MRL is 

x—>oo 

bounded, and those in which it is unbounded. We assume that the service time has an increasing 
mean residual life (IMRL) ?. 



VI 
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2.2. Utility function 

For each individual the utility function balances the reward from service with the expected waiting 
cost. Customers always take into account their future costs, while the time they already waited 
is considered a sunk cost. Each customer wishes to maximize his own utility; as a result, his best 
response is to stay as long as the utility is positive. To simplify, we first consider a case where 
abandonments are not allowed. Let G n (t) be the expected utility function value from staying until 
being served, for an individual that has n customers in front of him in the system when the current 
service age is t. Clearly, 

V n = 0 

G n (t) = < 

\v -C(K[X-t\X>t\ + {n-\)x) n> 1 
We next present a sequence of differential equations of the series G n (t) for n > 1. 


Proposition 1 The series G n (t ) solves the sequence of differential equations G' n {f) = C — 
/i(t)(G'„_i(0) - G n (t)) for n > 1. 


Proof First, one can see that G„_i(0) — G n (t) = CE[V — t\X > f] and hence the RHS of Propo- 
sition 1 equals C — Ch(t) E[V — t\X > t\. We also note that E[V — t\X > t] = — ■ Hence, the 

derivative of G n {t ) is 


dG n (t) = -F(t)F(t)+J(t)fZ t F(s)ds 
dt ' F(t ) 2 


C-Ch(t)E[X-t\X>t] 


which matched the derivative presented in the proposition, and hence we complete the proof. 
However, in our model, deriving the utility is not straightforward. Customers have to take into 
account the fact that abandonments may occur, that is, one needs to consider the possibility that 
he abandons a few moments later. Nonetheless, we next show that our utility function is similar 
to G n (t). This means that the possibility of abandoning later isn’t reflected in the utility function. 
We distinguish between two types of customers. Type i customers observed service completion and 
type ii customers didn’t. Due to the fact that keeping track of time is possible, type i customers 



Eliran Sherzer and Yoav Kerner: Customers’ abandonment strategy in an M/G/l queue 

Article submitted to Operations Research ; manuscript no. (Please, provide the manuscript number!) Vll 

know the exact service age at any moment. However, since the current service age is unknown 
upon arrival, type ii customers can only estimate it. Let U n (t) be the expected utility of a type i 
customer taking the optimal action in the next moment, given that there are n others in front of 
him in the system and t time units elapsed since the last service completion. 


Proposition 2 


U n {t) = (G n (t)) + , n> 0 


Proof n=0 implies that an individual is already in service, and hence has no cost. Clearly, the 
optimal action in the next moment is to stay. For n > 1, we first prove the proposition for n = 1 
and then prove for n > 2 by induction. For n = 1, we have 


Ui(t) = (h(t)dtU 0 ( 0) + (1 — h(t)dt)Ui{t + dt) — Cdt + o(dt)) + , t> 0 


If the RHS is negative, then the best response is to abandon, and hence the utility is zero. If the 
RHS is positive, then we have the following differential equation: 


where clearly, U 0 (Q) = V . This differential equation coincides with Proposition 1, and hence U\(t) = 
(V — C(E[X — t\X > t] +x)) + . We first assume that ) = (G„_i(t)) + . Based on our assumption, 

clearly, f7„_i(0) = (V — C(n — l)x) + . Combining with 

U n (t) = h(t)dtU n _ i(0) + (1 — h(t)dt)U n (t + dt) — Cdt + o(dt) 


therefore 


K(t) = c-h(t)(u n _ 1 (0)-u n (t)) 

and solving the differential equation complete the proof. 

Let U n (t ) be the utility of a type ii customer taking the optimal action in the next moment, given 


that n other in front of him in the system and t time units elapsed since his arrival. Formally, 
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let N be the number of customers in the system and A(t) be the service age, both upon arrival. 
Finally, let X n (t) follow the distribution of the service residual, given that upon the arrival of a 
tagged customer there were n customers in the system and t time units elapsed since then. That 
is, X n {t)= {X-A{t)\N=n}. 


Proposition 3 


Un{t) 


I V n = 0 

{V - C(E[X n (t) - t\X n (t) >t] + (n - !)£))+ n > 1 


Proof For n = 0 there is no cost, similar to U n [t). For n > 1, we have 

Unit) = C/ n _i(0)/i„(t)dt + (1 — h n (t)dt)U n (t + dt.) — Cdt + o(dt) 
where /i„(f) is the corresponding hazard function of X n (t). The differential equation is 

U'nit) = C- h n {t)iU n _M - U n it)) 

For both and C/ n (t) there are differential equations with the same structure. Hence, their 

solutions also have the same structure, where in this case, X is replaced by X„(t). 

Remark 1. The fact that service time has an IMR.L implies that both and R„(t) are decreas- 
ing with t. 

2.3. Strategy profile 

As mentioned, customers’ best response differs depending on the number of customers in front of 
them and which of the two different customer types they belong to. Therefore, each pair of queue 
length and customer type needs to be considered separately. Also, customers may balk, and clearly 
when the queue is long enough customers will not join. This happens when the utility is negative 
from the moment one arrives. Hence, under the assumption of rationality of customers, there is a 
maximum number of customers in the system, and it is denoted by n max . We show how to obtain it 
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in section 3.2. The customers’ strategy profile is as follows. All customers join if the system length 
is less than n max . Of course, joining customers will adapt their strategy according to the utility 
function, which is defined by the customer’s type and the number of customers in front of them 
in the queue. Both U n (t) and U n (t) are monotonically decreasing with t, and therefore the best 
response is unique and hence pure. Let T n be the time a type i customer who has n customers in 
front of him in the system is willing to wait from the moment of service completion until the next 
service completion occurs, or abandonment is made by the customer in front of him. Let A n be the 
time that a type ii customer who has n customers in front of him in the system is willing to wait 
from his arrival point until a service completion occurs, or abandonment is made by the customer 
in front of him. For any type of customer if, while waiting, service completion occurs, he updates 
his utility function and consequently his best response. However if, while waiting, the customer in 
front of him abandons, his best response is to abandon as well. This is because the customer in 
front, who abandoned first, gathered more information and his abandonment puts the customer 
behind in the exact same situation, to which the best response was to abandon. In conclusion, 
we have two sequences that define customers’ strategies. The first one is {T 1; T 2 , ...,T„ max _ 2 .} and 
the second is {Ai, A 2 , ..., A„ max _i}. The largest index value of the second sequence is A„ max _i, 
because it is the largest value observed upon arrival for which one would be willing to join. That 
is, if a customer joined and observed n max customers in the system, he would no longer join. In 
the first sequence, the largest index is obtained when a customer in the n max th position in the 
queue observes service completion. In this scenario, he has ?r max — 2 others in front of him after the 
departure of the customer who just completed his service. We next show how to obtain the values 
of T n and A n . 

3. Results 

3.1. Customer’s best response 

Using Propositions 2 and 3 we show how to obtain customers’ best responses, for both type 
i and type ii customers, given N = n. Specifically, we show how to obtain the sequences 
{Ti,T 2 ,...,T„ max _ 2 .} and {A l5 A 2 , ..., d nmax _!}. We begin with type i customers. 
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Lemma 1 If lim m x (t) < ^ — (n— l)x, and based on the utility function from Proposition 2, T n 
is the value of t that solves 

V — C(E[AT — t\X > t\ + (n — l)x) = 0 1 < n < n max — 2 (1) 

Otherwise, T n = oo. 

Proof Since n < n max — 2, the utility for t = 0 is positive and of course, customers will be willing to 
wait as long their utility is positive. Recall that the service time follows IMRL. Also, the condition 
lim mx(t) <7 - — (n — \)x means that for some value of t the utility will be negative. Therefore, 

£->-oo ° 

Equation (1) has a unique and finite solution. Otherwise, the utility will be positive for every t > 0 
and hence the best response is to stay forever. 

Of course, the solution of equation (1) is straightforward, and hence T n for any possible n can be 
easily obtained. 

Lemma 2 If lim m Xn it ) (t) <^ — (n— l)x, and based on the utility function from Proposition 3, 

£—>■00 ° 

A n is the value of t that solves 

V- C(E[X n (t) -t\X n (t) >t] + (n- l)x) = 0, 1 < n < n max — 1 (2) 

Otherwise, A n = oo. 

Proof We follow the same line of argument as Lemma 1. 

Solving ( 2 ) is not straightforward, mainly because obtaining the distribution of X n (t) is challenging. 
As mentioned, X n (t) = {X — A(t)\N=n} . That is, in order to obtain the distribution of X n (t), one 
must first obtain the distribution of A(t)\N=n. Let R(t,a) follow the distribution of the residual 
service time, given that the service age upon arrival is a and t time units have elapsed since the 
customer’s arrival. That is, R(t, a) = X — (t + a)\X > (a+t). Therefore, by using the law of total 
probability, the following equation is equivalent to ( 2 ): 


V-C (E[R(t,a)\N = n\ + (n-l)x)f Am \ N=n (a)da = 0, n<n max -l 


( 3 ) 


Yet fA( t .)\N= n (a) is unknown, and will be derived in the following sections. 
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3.2. Obtaining the maximum length of the queue 

Proposition 4 


Umax = sup | n € N : n < 


% - f a E[R(0,a)\N = n]f A(O )iN=n(a)da + x 


+ 1 


(4) 


Proof We seek the largest integer value of n that obeys U n { 0) > 0. Thus, after extracting n from 
equation (3) and applying the supremum we get the expression in (4). 

We observe that once f A(o)\N=n(a) is derived, n max can be computed. 


3.3. Markov chain underlying the process 

Our motivation for using a Markov chain is mainly to obtain the pdf of the service age for a tagged 
customer who observes n others in the system upon arrival, with t time units having elapsed since 
then. This will eventually allow us to find a strategy that holds for the Nash equilibrium. 

3.3.1. Markov chain state space First, we give some general notation for the steady states 
of the Markov chain: 


S = {(fc,a,ir fc+ i,w fc+2 ,...,w„_i)} 


where 

• k is the number of waiting customers that observed service completion; 

• a is the age of the current service; 

• Wi is the waiting time of the i th customer in the system; and 

• n is the number of customers in the system. 

A general steady-state density is denoted by p(k, a, w k+ i, w k+2 , and the probability density 

of having n customers in the system and a service age of a is denoted by 7r(n, a). It can be derived 
from the steady states of the Markov chain that 


77 


n— 1 r, 

(n,a) = ^2 / p(k,a,w k+ i,...,w n _i)dw, ?i>l,aeK + , 
k = o Ai 
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We denote the marginal probability of having n customers in the system by 7 r n , which is derived 
as 7r„ = J 7T (n, a) da. 

We first indicate some general and rather trivial relationships. From the arrival order, we get 
vj n _x < w n —2 — < u>k+ 1 < cl. Due to the abandonment strategies, we get a < T k for 1 < k < n max — 2. 
This is because, if a > T k , then the k th customer will have already abandoned by now. There are 
no constraints on a for k = 0. That is, if no-one observed service completion, the first in the queue 
could arrive at any value of a. By the same argument, 

Wi < Ai, for k + 1 < i < n — 1. 

For further analysis we present the following definition: let the state structure be the combination 
set of (n,k), where n is the number of customers in the system and k is the number of waiting 
customers that observed service completion. Since the queue length is limited, the Markov process 
has a limited number of different state structures. 

Proposition 5 The total amount of Markov chain state structures is 

I I ^max(^max T 1 ) 

I | — X 


Proof We first claim that if there are n customers in system, then there are n different state 
structures for I < n < n max — 1. What determines the number of state structures for a given n, 
is the number of different possible values of k, where 0 < k < n— 1. That is, the values of k can 
be from zero to n — 1 , because even if everyone observed service completion there would still be 
one in service. However, for n = n max there are n max — 1 different state structures. In this case, 
0 < k < n max — 2, while the state {n max — 1, a} is not possible. Finally, n = 0 means an empty system, 
with just one state structure. The total number can be computed as an arithmetic progression. It 
is equivalent to the sum b where each value of i represents the amount of state structures 

for a given n, except i = n max , which in this case includes cases for both ?7=0 and n=n max . From 
here the result is straightforward. 
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3.3.2. Finding the steady-state densities Due to the complexity of the process we begin 
with a simple example. Let us consider state (0,a), which refers to an active server with a current 
service age a and an empty queue. For a < A±, 

Pi 0, a) = p( 0, 0)e~ Aa F(a) (5) 

Equation (5) justifies the following. State (0, a) will always follow state (0, 0). This means that state 
(0,0) occurred, and during the intervening a time units there were no service completions and no 
arrivals. Thus, the probability density of p(0,a) is as for p(0,0), times the probability that there 
were no service completions nor arrivals. However, for a>Ai, we allow arrivals to occur from the 
beginning of service, assuming that they will have abandoned by the time the service reaches age 
a. For mA 1 <a< {m + 1 )H 1 , where m € {0, 1,2, 3...}, it is possible that a customer will arrive and 
abandon after A 1 time units. If, during the stay of the new arrival, more customers arrive, then 
they will not be in the queue once he abandons. This is because, if they stayed until then, they 
would abandon as well, since the customer ahead of them abandoned. This process can happen no 
more than m times, for a < ( m + V)A\. For example, if m = 1, which means Ai < a < 2A 1} then 
two cases are possible: no arrivals at all and no service completion, or one arrival who abandoned 
before the state reaches (0, a) and no service completion. From basic probability we obtain 

p{ 0, a) = p( 0, 0)(e _Ao + A e~ Xa (a - A 1 ))F(a) 


Thus, p( 0, a) is equal to p( 0, 0) times the probability that no service completion occurs and there 
were from 0 to m arrival events followed by abandonments. We next give a general expression. Let 
g(k,n,m,a) be 


g(k,n,m,a ) = < 


(E”l 0 AJe " Ma ~^; )(a - M " )J ) F(a) 

fs^rn - jAn )0 

0 j\ 


F(a-w n - 1) 


1 ^ k 1 — Tl ^ 'H-max 2 
1 ^ k + 1 Tl ^max 1 


F(a) 

F(a-w n - 1) 


Fb ^max 



XIV 
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and 


N 0 k = 0 

m € < 

{0,1,2,... } 1 < fc < n max — 2 

where a is the current service age, w n - 1 represents the waiting time of the last joining type ii 
customer who observed n — 1 customers in the system upon arrival, n is the number of customers 
in the system, and m relates to the possible values of a: specifically, mA n <a< (m + l)A n . Lastly, 
k is the number of customers who observed service completion. 


Lemma 3 The function g(k,n,m,a ) is represented differently in three cases. 

Case 1, with 1 < k+l=n < n max — 2, represents the probability that the current state is (k,a), given 
that a time units ago the state was (k,0). 

Case 2, with l<k + \<n< n max — 1, represents the probability that the current state is 
now (k,a,Wk+i—w n - 2 ,w n -i), given that w n _i time units ago the state was (k,a — w n _i,w k+1 — 
•u;„_i,...,in ri _2 0). 

Case 3 represents the probability that the current Markov state is (fc,a,rc fc+ i...,rc„ max _2,u'n max -i), 
given that w„ mK _i time units ago the Markov state was: 

(k, a-Wn max -l,U! k+1 -W nmax _ 1 ,...,W n ^ 2 -W nm ^_ 1 ,0). 


Proof Case 1: in order that the state (&;,0) will be replaced by the state (k, a) after a time units, 
we need to ensure that there will not be a service completion during those a time units. Also, we 
need to ensure that there will not be any new arrivals, or if there are, then they will have abandoned 
by the time the Markov chain state reaches (k, a). The probability of no service completion is F(a). 
The probability of not having new arrivals once the state reaches (. k,a ) is 


\j e -Ha-jA n )( a _jA n y 


Of course, scenarios which include more than one abandonment made by the (n + l) th customer in 


the system are under consideration, where j is the number of times it occurs. We also note that 
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j < TO. 

Case 2: in order that the state (k,a — w n _i,w k +i — w„_ 2 — w n -i,0) will be replaced by 

the state (k,a,w k+ i...io n _ 2 ,io n _i) after u>„_i time units, we need to ensure that there will not 
be service completion and no new arrivals which stayed during that time (similar to Case 1). 
The probability that there will not be service completion is P(X > a\X > a — w n -±), which is 
equivalent to — 7 . In Case 3, new arrivals are not a possibility anyway, and therefore, in 

order that the state will be transposed from (k, a- w„ max _i, w k+1 ~ w„ max _i, ..., w„ max _ 2 -tc„ max _i, 0) 
to (k, a, w k+ !■■■, w n m ^ - 2 , Wn maJ c- 1 ), we only need to ensure that there will be no service completion, 
which is . as in Case 2. 

Fya—Wn) 

Hence, from Lemma 3 we have, for mA n <a< (m + 1 )A n , 


p(k,a,w k+ 1 , ...,w n - 1 )=p(k,a-w n _ 1 , ...,w n _ 2 -w n _ 1 ,0)g(k,n,m,a) 


( 6 ) 


From ( 6 ) we see that it is possible to separate the expression of the steady-state densities of the 
Markov chain into two parts. The first one is also a steady-state density of the Markov chain, for 
which the last argument is set to be 0. The second is the function g(k, n, to, a), which is computable 
given the model parameters. Therefore, in order to obtain the steady-state densities of the Markov 
process we need to find those in which the last argument is set to be 0. From the balance equations, 


A 7 Tq = / p(0,a)h(a)da 

J a 


A p(k , a, w k+ 1 , ...,w n _ 1 ) = p(k, a, w k+1 , ..., 0 ) 


P n— 1 

/ y jP (i, a, w i+1 , ..., w n+1 )h(a)da = p(n , 0 ) 

i = 0 


( 7 ) 

( 8 ) 
(9) 


Recall from Proposition 5 that the number of state structures is " max(ra 2 max+1 ^ . Excluding the state 
0 for each state structure, there is single state for which the argument is 0. Therefore, from equa- 
tions (7) to (9) we have ramax ^ n 2 max+1 ^ equations. Where in fact from (7) consist one Equation, ( 8 ) 
consist Wmax( ” max ~ 1) +2 and (9) consist n max — 3 equations. Combined with ( 6 ) and the fact that 
J2n=T = 7’ the steady states of the Markov process is derived. 



XVI 
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Remark 2. For numerical computations, we guess a value for n 0 . Using equations (6) to (9), we 
compute YCrCo ^n- If the total sum is smaller than 1, we guess a larger number for ir 0 and vice 


We next give a special case where n max = 3. There are 6 different state structures, and they are 
represented as {(0), (0, a), (0,a,uq), (l,a), (1, a,w 2 ), {0,a,wi,w 2 )}. From balance equations we state 


/»oo 

A7To = / p(0,a)h(a)da 

J a - 0 


Ap(0, a) = p( 0, a, 0) 


Ap(0, a, w i) = p( 0, a, wq,0) 


p(0, a, Wi)h(a)da = p( 0, 0) 


p(0,a,wi,w 2 )h(a)da = p(l,0) 


Ap(l,a) =p(l,a,0) (15) 

Using equations (6) and (10) to (15), and applying the numerical procedure from Remark 2, all 
steady states can be computed. 


3.4. The age distribution given the queue length 


We next show how to obtain /u(t)|v=n(a), while using the steady-state probability densities of 
the Markov chain. Let Y follow the distribution of the total amount of time a tagged customer 
waited from arrival until either he abandons or there was service completion, sampled by an outside 
inspector at an arbitrary moment. In fact, {A(y)\N =n} = {A\N =n,Y =y} . From Bayes’ law, 


fA\N=n,Y=y{c i ) ~ 


fy\N=n,A=a{y) f A\N=n{a) 

f a fr\N=n,A=a{y) f A\N=n{a)da 
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Since the presentation in a general case is implicit, we demonstrate using a special case of n max = 
3. However, we can proceed similarly for any value of ?r max . We show separately how to obtain 
f A\N=n (u) and fy\N=n,A=a{y ) for both N = 1 and N = 2. fA\N=n(a) can be derived directly from 
the steady-state densities of the Markov process, specifically for N = l, 


/a|jv=i(o) 


g(M 

TTl 


and for N = 2, 


/u|AT=2(gO — 


Kb a) + Cl A o a p(0, a, Wi)dwi 


7T 2 


We next derive fr\N=i,A=a(y)- Let Q be a random variable that represents the inter-arrival times. 
Of course, Q ~ Exp(A). Due to the PASTA property, an outside inspector sampling times is 
equivalent to customer arrival times. Therefore, Q\Q < R( 0, a) A A 1 is equivalent to Y\ N =1, A=a. 


Lemma 4 The conditional density of Y given A=a, N=1 is 

Xr-Xy Fja+y) 

F(a) 


P(Q<A x A R(0,a)) 


and 


nOO 

<A x /\ R(0,a))= / (1 — e~ Xr )dr + / (1 -e~ XAl )dr 

Jr — 0 J r=Ai 


Proof 


< y\Q < R{0,a) A AJ = 


< y , Q < R{0, a) A A x ) 


< R( 0, a) A A±) 

We give explicit expressions for both numerator and denominator. 

The numerator is 


rv 

/ r—0 


<r) /( ° + r b r + 

- F(a) 


<y) f -t±A d 

r(o) 


I P(Q<y,Q< R(0,a) a A^ = 

and the denominator is 

P(Q< J R(0,a)AA 1 )= [ 1 F(Q<r) /( ” + ^ ) dr+ [ P(Q < A,) /( ° + r) dr 
J r=o L (a) Jr=A! T (a) 

After taking the derivative, we get the pdf of Q|Q < R(0,a) A A 1} and hence of y|A^ =1, A=a as 


well. 
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We next derive fy\N= 2 ,A=a{y) ■ Let W\ be a random variable taking value of w- Y given that the 
state is (0,a,u>i), sampled at an arbitrary moment. The pdf of W\ is denoted by f Wl (wi), and it is 
equivalent to A p ^ a ’ wi '> . When a customer arrives to a system given that N = 2, there are two 

fu=0 p(0,a,u)du 

possible state structures: i. p( 1, a) and ii. p( 0, a, W\). Let I be an indicator that receives the value of 
1 when the state structure is p(l,a), and receives 0 when it is p(0,a,Wi). From simple probability 
considerations, P (/ = 1) = • We indicate that Q\Q < R(0,a) A A 2 A (/(T-, — 

P(l>a )+/ W1 =0 p(0,a, W1 )dw! 

a) + (1 — I)(A 1 — Wi)) is equivalent to Y\N=2,A =a. 


Lemma 5 

Y < (/(Ti - 


The conditional density ofY given A = a, N = 2 and 
a) + (1 — I)(Ai — Wi)) A A 2 A i?(0, a) is 

Xe -\yF (a±Y> 

Pf I = 1) — 1- 

1 J F(Q<A 2 AR(p,a)A(T 1 -a)) 


C A 1 


P(/ = 0) 


\ -\ V F(^+V) 
F(a) 


f wi — 0 


< A 2 A R( 0, a) A {Ai — rci)) 


p(0, a, Wi)dwi 


and 


F(Q < A 2 A i?(0, a) A (Ti — a)) = 


"(T 1 -a)AA 2 


' r —0 


f{a + r ) 
1 — F(a) 


dr + 


f r—A2/\{T\—a) 


<(T, 


a) A A 2 ) 


/(a + r) 

F(a) 


dr 


and 


P(Q < A 2 A R( 0, a) A (Ai — Wi)) = 

Aa 1 -^w 1 )aa 2 f( , \ 

/ F(Q<Y J[ 

Jr— a 


F(a ) J r=(Ai~-wi)AA2 


< (A ± - w 1 ) A A 2 ) dr 

F(a) 


The proof is given in Appendix A. 


3.5. Relations between the thresholds 

In this section we refer to some trivial and nontrivial results concerning the values of the sequences 
{Ai, A 2 , A„max-i} an d {Ti,T 2 , •••,T„ max _ 2 }. Specifically, we describe the dependencies and bound- 
aries between them. Intuitively, the more customers are in front of you, the less you would be 
willing to wait. 
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Lemma 6 If T t < oo, T, > T i+1 for 1 <i< n max — 3. 

Proof Recall that t in equation (1) refers to the time one waited in the queue since service 
completion. Due to the fact that E[X — t\X > t ] is increasing with t, it follows straightforwardly 
that the larger the value of n the lower the value of t that solves the equation, and hence the lower 
the value of T n . 

Lemma 7 If ^4, < oo, A > A i+1 for 1 < i < n max — 2. 

Proof Suppose an individual observed n + 1 customers upon arrival. The last event prior to his 
arrival could be either an arrival, an abandonment or a service completion. If it were an arrival, 
then clearly the one who observed n customers was in a better situation when he arrived. If it 
was an abandonment, then this individual (if he knew) should not join at all, and hence he is in a 
worse situation than the one who observed n upon arrival. The last case is that where the arriving 
customer is the first to arrive during the current service period. In this case, the age of the service 
time is his inter-arrival time. Yet, the greater the queue length, the smaller the probability of such 
an event. 

We also observe that all {Ti,T 2 , • ••T„ max _ 2 } are obtained independently of everything else. This 
is a direct result from equation (1), where the value of T n is determined by the values of the 
model parameter and n. Moreover, we claim that A t , for Vi € {1, 2, ...n max — 2}, depends only on 
{Ai, A 2 , Ai_x} and {Tj,T 2 , ...,7)}, and for i = n max — 1, is dependent only on {A 1 , ...Ai_i} and 
{Tj,T 2 , ...,T„ max _ 2 }. This result is rather surprising, because intuitively the entire history of a busy 
period would effect the value of A t . But the values of A ; are not affected by {A i+1 , ..., -A nmax _i} 
and {T i+1 , ...T„ max _ 2 }. The intuition behind this is that the queue state upon arrival of one who 
observed i customers is not affected in any way by customers that arrived and observed i + 1 or more 
in the current busy period. This is due to the fact that customers don’t make their decisions with 
respect to what happens in the queue behind them. Customers are only interested in what happens 
in front of them. This is what allows us to compute the values of A, for Vi £ {1, 2, ..., n max — 1}. 



XX 
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Theorem 1 The Nash equilibrium profile is defined by two finite sequences of thresholds, 
{Ti,T 2 ,...T nmax _ 2 } and {A 1 ,A 2 ,...A ningbX _ 1 }, which are distinguished by the customer types. Within 
each sequence, from an individual point of view, each threshold is determined by the number of 
customers in front of him. 

Proof Customers’ strategies are determined by their utility functions. Based on Propositions 2 
and 3, we claim that there are two sequences because the different customer types have different 
utility functions, and therefore their strategies are different as well. The sequence lengths are a 
direct result of Proposition 4 and the definition of the steady states of the Markov chain. Finally, 
the fact that the Nash equilibrium profile within each sequence is defined by thresholds was already 
proved in Lemma 1 and Lemma 2. 

3.6. Numerical result 

We present an example where the service distribution is hyperexponential, and the model param- 
eters are V = 4.85, c = 1, /Xi — 1, /x 2 = 0.2, p = 0.95 and A = 3. The (symmetric) Nash equilibrium 
is n max = 3 , Ti = 7.73, A 1 = 7.202 and A 2 = 3.13. 

4. Conclusions 

In this study we show how to obtain the Nash equilibrium in an observable M/G/l queue with 
abandonments. We focus on service time distributions which have an IMRL. The Nash equilibrium 
is defined by two sequences of thresholds. The values of the sequence {Ti, T 2 , •••T lmax - 2 } are obtained 
by solving a linear equation. However, obtaining the values from the sequence {Ai, A 2 , •••Ai max _ 1 } 
is much more difficult. They can be computed recursively based on the definition of the Markov 
process. The reason we are able to obtain them recursively is because customers’ decisions are not 
effected by future arrivals, and therefore they are transparent to them. In other words, from the 
point of view of a customer who is in the n th position in the queue, the maximum length of the 
queue is n. Finally, a numerical example is given in which both sequences are computed. 
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Appendices 

A. Appendix A 

Proof 


P(Q < y\Q < R{ o, a) A A 2 A (/(Ti - a) + (1 - I)(A 1 - Wi))) 

_ P(Q < y, Q < R( o, a) A A 2 A (/(Ti - a) + (1 - J)(A - Wd)) 
P(Q < i2(0, a) A A 2 A (/(Ti - o) + (1 - /)(A - W 1 ))) 


We give explicit expressions for both the numerator and the denominator. 
The numerator is 


<y,Q< R( o, a) A A 2 A (/(Ti -a) + (l-I)(A 1 -W 1 ))) 

I'M A O 


P(I = 1)P(<5 <y,Q < R(0, a) A A 2 a (Ti - a)) 


' w\— 0 


/•A 2 A(A 1 -ui 1 ) 

+ P(/ = 0) / P(Q < y, <5 < i?(0, a) A A 2 A (yli — rt>i))p(0, a, mi)da 

J a- 


' a — 0 


and the denominator is 


< i2(0, a) A A 2 A (/(Ti - a) + (1 - I){A ± - WJ)) 
■AA ffl 

[P(/ = 1)P(Q < R{ 0, a) A A 2 A {T x - a)) 


' ici — 0 


+ P (/ = 0)P(Q < R( 0, a) A A 2 A (A± — tci))]p(0, a, Wi)dwi 


After taking the derivative, we obtain the pdf of Q\Q < R( 0, a) A A 2 A (/(T — a) + (1 — /)(A! — Wi)), 
and hence of Y\N =2 ,A=a as well. 



